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instantiations  of  more  generic  representations.  Student  explanations  of  a  variety  o 
Jynamic  skill  tasks  are  analyzed  in  this  framework.  An  experimental  computer-based 
dynamic  skill  task  is  ui>ed  to  permit  detailed  observation  of  student  performances 
that  are  analyzed  in  terms  of  the  proposed  representation  format. 


ABSTBACT 

Intelligent  Coaputer  Aided  Inatruotlon  (ICAl)  requires  aaohlne 
understanding  of  student  knowledge  and  skills.  Methods  for 
representing  knowledge  about  a  ooherent  set  of  tasks,  dynaalo  skill 
tasks,  are  presented.  A  foraal  ^stea  appropriate  to  the 
representation  of  teaporality,  events,  and  notions  Is  adopted.  A 
seaantlo  ooapositlon  aethod  naturally  proaotes  a  *degrees  of 
speolflolty*  approach  to  the  representation  at  knowledge.  Soae, 
presuaably  widely  held,  eleaents  of  dynaalo  skill  knowledge  are 
doaaln-lndependent.  Others  are  speolflo  to  partloulsr  task  doaalos. 
Many  task-speolf io  representations  oan  be  seen  as  Instantiations  of 
acre  generlo  representations.  Student  explanations  of  a  variety  of 
dynaalo  skill  tasks  are  analysed  In  this  fraaework.  An  experlaental 
ooaputer-baaed  dynaalo  skill  task  Is  used  to  peralt  detailed 
observation  of  student  perfomanoes  that  are  analyzed  In  terms  of  the 
proposed  representation  format. 
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REPRESENTING  DYNAMIC  SKILL  ENOVLEDGE 


BACKGROOND 

New  hope  for  the  future  of  oonputer-baaed  Instruction  (CAI)  cornea 
froB  three  aourcea.  One  la  a  trend  toward  software  syatems  that  do 
not  appear  to  be  CAI  In  the  traditional  sense.  These  are  prograns 
that  present  a  rich,  manlpulable  domain  to  learners.  Experimental 
examples  of  such  syatems  Include  Bornlng's  (1979)  ThlngLab  and  the 
Equipment  Simulation  Authoring  System  (ESAS)  (Towne  A  Munro,  1984).  In 
the  commercial  sector «  the  Fllevlslon  program  for  the  Apple  Macintosh 
computer  also  has  the  characteristic  of  providing  users  with 
undirected  access  to  a  complex  environment  of  data  and  graphics  over 
which  they  have  direct  control. 

Traditional  CAI  systems  provide  students  with  only  minimal  control 
over  the  systems  they  make  use  of.  The  new  trend  In  Interactive 
applications  does  not  force  the  author  of  an  application  to  envision 
every  possible  use  that  might  be  made  of  it.  In  CAI  systems  such  as 
PLATO  or  TICCIT,  every  branch  that  a  student  might  take  must  be 
explicitly  coded  by  the  application  author.  In  ThlngLab,  ESAS,  and 
Fllevlslon,  authors  create  rule-governed  environments  that  users  can 
explore  In  a  free-play  fashion.  This  trend.  If  pursued,  will  liberate 
CAI  from  the  Programmed  Instruction  paradigm.  Students  will  become 
tool-users,  able  to  use  computer  systems  as  devices  to  aid  learning. 
Just  as  writers  use  word  processing  programs  as  an  aid  to  writing  and 
financial  analysts  use  spreadsheets  as  an  aid  to  decision  making. 

A  second  hopeful  trend  In  CAI,  exhibited  by  the  same  systems  cited 
as  examples  of  student-controlled  applications,  is  that  of  providing 
application  authors  with  object-oriented  methods  for  building 
applications.  Authors  can  select  meaningful  objects  and  compose  them 


Into  slaulated,  funotionlng  noenoa  uaing  thaaa  ayatema.  Beoauae 
ooaputer  prograomlng  akllla  ara  not  requlrod  to  make  uae  of  auoh 
authoring  ajataaa,  aubjaot  natter  ezperta  oan  produce  high-quality 
alaulatlona  at  lover  ooat. 

The  noat  Inportant  next  atage  advanoea  In  CAI  are  likely  to  come 
In  the  area  of  Intelligent  Inatruotlon  —  the  reault  of  applying 
artificial  Intelllgenoe  nethoda  to  training  problena.  Thla  la  the 
third  trend  that  la  likely  to  have  algnlfloant  effeota  on  CAI» 

Inoreaalng  Ita  effeotlveneaa  and  extending  the  donalna  In  which  It  can 
be  effectively  and  econonlcally  employed.  Ve  are  particularly 
Intereated  In  the  problen  of  providing  aupervlaorlal  Intelligence  for 
dynamic  almulatlon  training.  An  Intelligent  tutor  could  provide 
Individualized  coaching,  Inatruotlon,  and  almulatlon  control  In 
reaponae  to  the  courae  of  eventa  In  training  almulatlona. 

Two  baalo  laauea  muat  be  reaolved  If  Intelligent  tutorial  la  to  be 
auooeaafully  Implemented  for  almulatlon  training.  The  fir at  la  to 
determine  a  combination  of  repreaentatlon  format  and  metboda  of  analyala 
that  oan  be  uaed  to  repreaent  expert  and  atudent  underatandlng  of  the  taak 
for  the  purpoaea  of  training.  The  aecond  la  to  provide  a  method  by 
which  a  aubjeot  matter  expert  can  encode  the  expertlae  required  by  the 
tutor  —  In  effect,  to  provide  an  authoring  ayatem  for  Intelligent 
tutora. 

Thla  report  deala  with  the  flrat  of  theae  laauea  —  devlalng  a 
repreaentatlon  for  generic  dynamic  aklll  knowledge.  Based,  in  part,  on 
a  format  devised  by  Allen  (1984),  the  representation  Includes  semantic 
primitives  appropriate  for  the  representation  of  elementary  concepts 
of  dynamic  skill  tasks.  Including  duration,  simultaneity,  temporal 
overlap,  and  do  on.  An  Intermediate  level  of  representation,  composed 
of  the  primitive  elements,  conveys  a  number  of  dynamic  skill  concepts 
such  as  Hal t-For- Event- to- Perform,  and  so  on.  At  a  higher  level.  It 
provides  a  generic  schema  for  Interactive  task  environments. 


REPRESEMTATIQH  PDHDAMENTALS 

One  objective  of  our  work  baa  been  to  begin  assembling  a  general 
inventory  of  characteristics  of  dynamic  tasks.  By  examining  a  set  of 
specific  task  environments,  in  a  manner  similar  to  the  exploratory 
work  of  Kieras  concerning  device  representations  (Kieras,  1984;  Kieras 
&  Bovarir,  1983)(  we  have  identified  a  significant  number  of 
processes,  actions,  and  events  required  to  represent  a  range  of 
dynamic  tasks. 

The  following  six  rule  forms  or  rule  schemata  are  typical  of  the 
primitive  elements  which  are  Involved  in  many  dynamic  tasks: 

1.  Action  a  must  precede  action  b. 

2.  Action  a  must  be  performed  laDedlately  before  action  b. 

3.  Action  a  must  be  started  before  event  b  occurs. 

4.  Action  a  must  be  finished  before  event  b  occurs. 

5.  Action  a  must  be  initiated  within  <t  time>units>  following 

event  b. 

6.  Action  a  must  not  be  performed  during  event  b. 

At  a  somewhat  less  abstract  level,  many  dynamic  task 
representations  must  refer  to  elementary  concepts  from  a  small  set  of 
positional  and  movement  primitives.  These  can  be  expressed  by 
statements  such  as 

7.  Object  i  is  near  object  J. 

8.  Object  i  is  below  object  J. 

9.  Object  i  is  heading  toward  object  J  (or,  in  direction  d). 

10.  Object  i  has  speed  s. 

11.  Object  1  is  new. 

12.  Object  1  has  disappeared. 

Dynamic  skill  tasks  appear  to  require  a  semantic  Inventory  that 
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Includes  such  concepts  as  precede,  started  before,  finished  before, 
not  during,  near,  below,  beading  toward,  speed,  and  so  forth.  Many 
■ore  ooaplez  dynaalo  skill  concepts  can  be  defined  In  terms  of  such 
■ore  prlaltlze  elements. 

The  primary  rationale  for  developing  this  Inventory  was  to 
determine  what  form  of  representation  system  la  required  to  accomodate 
a  wide  range  of  complex  time-constrained  man-machine  Interactions. 
Rules  1  and  2,  for  example,  express  simple  sequence  constraints  of  the 
type  that  would  be  used  to  represent  a  aerial-action  task  (a  non¬ 
dynamic  task  In  which  durations  are  Irrelevant,  such  as  equipment 
troubleshooting).  In  general,  serial-action  task  environments  may  be 
treated  as  special  cases  of  the  more  general  dynamic  task  environment. 
Moreover,  a  dynamic  task  may  have  aspects  which  are  serial  In  nature. 
Thus  rules  1  and  2  are  useful  for  characterizing  some  portions  of 
dynamic  tasks. 

Rules  3,  4,  and  5  reflect  some  of  the  nature  of  dynamic  tasks.  In 
which  the  performance  of  one  action  Is  related  to  the  timing  of  other 
actions  and  events.  Rule  3  also  allows  a  degree  of  slmultaneaty, 
while  rule  6  expresses  a  specific  prohibition  against  the  concurrency 
of  events  a  and  b. 

While  the  generic  primitives  for  dynamic  tasks  are  expressed  In 
English,  they  provide  a  clear  Indication  of  the  flexibility  and  range 
of  relationships  needed  In  a  formal  representation  system.  The  six 
temporal  relationship  primitives  listed  above  demonstrate  three  of  the 
central  requirements  which  a  computational  theory  of  action  must  meet: 

1.  Effects  and  Interactions  among  actions  must  be  expressible  and 

computable;  It  Is  not  sufficient,  for  example,  to  simply  represent 
temporal  order  of  events  or  simple  causal  relationships  with 
primitive  logical  operators  of  the  form  "If  a  then  b". 


2.  Slaultaoeous  actions  and  events  must  be  expressible,  with  no 
Inberent  limitation  on  the  number  of  such  concurrent  elements.  The 
situation  calculus  (McCarthy  &  Hayes,  1969)»  which  represents  the 
world  with  static  states  achelved  via  the  performance  of  particular 
actions,  does  not  satisfy  this  need. 

3.  The  formalism  must  be  able  to  express  Inactivity,  as  in  rule  6, 
and  non^oontlnuous  activity  (such  as  resummlng  an  interrupted 
action). 

Other  requirements  of  a  formalism  result  from  its  Intended  basis 
for  instructional  purposes.  These  Include  the  need  to  recognize  a 
performer's  intentions  and  plana  and  the  need  to  represent  time  in  a 
manner  which  would  allow  tutorial  functions  to  recognize  tlme^orltlcal 
situations.  (For  example,  if  a  tutor  observes  a  student  strike  a 
function  key  Just  a  fraction  of  a  second  too  late  after  performing  a 
number  of  equally  critical  actions  within  their  alloted  time,  it  may 
be  inappropriate  to  classify  the  error  as  "forgetting  to  type  the 
function  key  during  the  required  period.") 

A  representation  system  which  adequately  accomodates  a  useful 
range  of  dynamic  task  environments  must  be  extremely  rich,  flexible, 
and  adaptable.  He  believe  this  can  be  best  accomplished  by 
constructing  a  relatively  small  number  (less  than  one  hundred, 
perhaps)  of  generic  primitive  rules.  From  these,  a  second  tier  of 
more  specific  rules  would  be  constructed.  At  this  (second)  level  or 
above,  rules  would  be  constructed  to  meet  particular  needs  of  an 
application,  such  as  the  Air  Intercept  Controller  (AIC)  task.  He 
would  expect  that  many  of  the  second-and  third-' tier  rules  to  also  be 
of  general  use  in  future  applications.  Each  domain-specific  rule 
would  be  expressed  in  terms  of  lower-level  domain-independent 
elements.  Possibly  some  would  be  built  using  the  first- tier 
primitives,  others  would  involve  more  complex  construction. 


Ve  propose  to  construct  formal  dynamic  task  primitives  to  represent 
the  English  rules  In  our  current  Inventory  using  the  formalism  for 
reasoning  about  actions  developed  by  J.  P.  Allen  (AI»  1984).  This 
formalism  Is  based  upon  a  theory  of  temporal  logic  which  recognizes  time 
Intervals  rather  than  distinct  points.  Allen  defines  a  small  set  of 
predicates  which  express  the  properties  of  various  time  periods.  A 
fundamental  predicate  la  HOLD,  described  below: 

HOLD  (p,t)  which  la  true  If  and  only  If  property  p  holds  during  time  t 

and  a  number  of  predicates  related  to  time  periods: 

DURING  (t1,t2)  time  Interval  t1  Is  fully  contained  In  t2 

STARTS  (t1,t2}  time  Interval  t1  shares  the  same  beginning  as  t2,  but 

ends  before  t2  does. 

FINISHES  (t1,t2}  time  Interval  t1  shares  the  same  end  as  t2,  but  begins 

after  t2  begins. 

BEFORE  (t1,t2)  time  Interval  t1  Is  before  Interval  t2,  and  they  do  not 

overlap  In  any  way. 

OVERLAP  (t1,t2)  time  Interval  t1  starts  before  t2,  and  they  overlap 
MEETS  (t1,t2)  Interval  t1  Is  before  Interval  t2,  but  there  Is  no 

Interval  between  them;  t1  ends  where  t2  starts. 

EQUAL  (t1,t2)  t1  and  t2  are  the  same  Interval. 

—  Allen  (1984) 

From  these,  higher  level  predicates  may  be  constructed.  For 
example  IN{t1,t2)  can  be  defined  in  terns  of  DURINO,  START,  and  FINISHES 
to  express  that  t1  Is  wholly  contained  In  t2. 

HOLD  specifies  the  truth  of  a  property  over  a  time  period.  A 
second  key  object  In  the  ontology,  OCCUR(e,t),  Is  true  If  and  only  If 
event  e  happened  during  time  t  (and  not  during  any  subinterval  In  t). 

In  most  respects,  the  primitive  predicates  have  the  sane  role  In 
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more  than  they  describe,  Is  supported  by  student  responses  to  Informal 
questions  about  described  tasks,  by  their  performance  on  the  tasks,  and 
by  interpretations  of  their  sometimes  sparse  descriptions  that  Impose 
consistency. 

To  analyze  IndlTldual  student's  representations  for  tasks,  methods 
must  be  devised  that  do  not  rely  on  verbal  or  textual  descriptions.  A 
potentially  ideal  method  would  make  use  of  student  task  performance  to 
derive  such  representations. 


propositions  from  a  oomposlte  representation,  oan  be  developed  for 
eliminating  obvious  errors  from  the  "Inclusive  oorreot"  representation. 
The  result  of  applying  this  prooedure  la  to  oonatruot  a  model  of  an 
Ideal  all-knowing  task  expert.  This  expert  model  Includes  all  the 
correct  Information  displayed  In  the  collected  descriptions  of  the  task, 
while  excluding  Individual  errors. 

The  approach  of  proposltlonally  analyzing  many  descriptions  of  a 
task  may  prove  to  be  a  fruitful  one  for  deriving  "possible  expert" 
knowledge  about  a  task  domain  —  the  knowledge  that  some  deal  expert 
might  have  about  the  task.  This  approach  has  less  appeal  for 
determining  appropriate  Individual  representations  of  task  knowledge.  A 
method  that  piurports  to  discover  an  Individual's  knowledge  about  a  task 
must  make  use  of  task  performance  data. 

Not  all  elements  of  a  representation  such  as  the  oomposlte 
propositional  representation  for  the  PLAI-IHVADEBS  Usk  (given  on  page 
10  and  In  a  notatlooal  variant  In  Figure  1)  are  equally  central  to  an 
expert's  conception  of  the  task.  For  example,  the  Ideas  of  shooting  the 
aliens  and  avoiding  their  weapons  are  much  more  Important  than  the 
concept  that  the  aliens'  weapons  destroy  the  blockades.  Frequency  of 
mention  Is  one  measure  of  centrality  of  component  concepts. 

Propositional  analysis  of  many  task  descriptions  may  be  a  useful 
method  for  deriving  a  comprehensive  "expert"  representation  of  the  task, 
but  It  Is  not,  by  Itself,  an  adequate  method  for  determining  Individual 
representations.  Individual  task  descriptions  can  reveal  Intrusive 
errors  In  task  understanding.  They  cannot  be  relied  on  to  reveal  gaps 
in  understanding,  however,  because  many  students  fall  to  describe  much 
that  they  seem  to  know  about  the  task.  This  claim,  that  students  know 


A  ooBpo8it«  repreMntatlon  (eltbar  grapbioAl,  aa  In  Figure  1,  or 
propositional,  as  at  the  beginning  of  this  section)  can  be  constructed 
on  the  basis  of  the  descriptions  of  many  subjects.  Each  student's  coded  * 

propositions  can  be  related  to  the  composite  representation,  largely  by 
Identifying  Identities  of  reference,  but  sometimes  by  adding  new 

propositions.  J 

What  Is  the  status  of  a  composite  representation  derived  by  this 
method?  One  claim  that  can  be  made  about  such  representations  Is  that 
they  are  fictions.  According  to  this  claim,  no  single  student  knows  • 

everything  about  the  task  that  Is  conveyed  In  the  composite 
representation.  Since  there  la  no  "group  mind*  that  holds  the  entire 
composite.  It  does  not  make  sense  as  a  representation.  The  oLly 

representations  that  make  sense  are  representations  for  Individuals'  * 

understandings,  baaed  on  their  descriptions. 

A  second  claim  Is  that  the  composite  representation  is  a  good  >  ^ 

representation  for  most  students'  understandings  of  the  task.  According 
to  this  claim,  all  the  students  have  this  essential  understanding  of  the 
task,  but  some  are  better  at  expressing  it  than  are  others. 

Neither  claim  can  be  completely  correct.  Many  students  seen  to 
know  more  about  the  task  than  they  Include  In  their  descriptions.  A 
representation  such  as  that  given  by  Student  #3  lacks  the  cohesiveness 
required  for  a  complete  task  description.  Furthermore,  we  suspect  that 
many  of  the  students  would  perform  the  task  In  a  much  more  adequate 
fashion  than  their  descriptions  would  suggest.  On  the  other  hand,  some 
students  have  incomplete  and/or  Incorrect  Ideas  about  the  task.  We 
certainly  would  not  want  to  Include  erroneous  propositions  In  the 
composite  representation.  It  would  not  make  much  sense  to  say  that  a 
student  shared  In  the  composite  representation  when  performance  data 
suggested  clear  errors  and  omissions. 

Operational  methods,  such  as  excluding  all  Idiosyncratic 
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Figure  3. 
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Figure  2. 

Sttijtcis 


Th«  relationship  batwean  a  partloular  atudant'a  dasorlptlon  of  a 
tha  task  and  tha  oonposlta  raprasantatlon  oan  ba  nora  aasllj  appraclatad 
vban  both  ara  praaantad  as  natvork  graphs.  Plgura  ■Cooposlta 
Saaantlo  Raparasantatlon*  oonrajs  tha  aaaa  Inforaatlon  Inoludad  In  tha 
saquanoa  of  propoaltlona  dlaplajad  at  tha  beginning  of  this  section. 
Partloular  instantiations  (or  partial  Instantiations)  of  predicates  ara 
raprasantad  as  ovals  surrounding  tha  pradloata  label.  Subscripts  are 
unnacassarf,  since  identity  of  rafaranoa  is  portrayed  by  pointing  to  tha 
Sana  oval. 

The  pointers  represent  tha  bindings  batuean  predicate 
Instantiations  and  their  arguaants  (uhiob  nay  tbaasalves  ba  predicate 
instantiations).  Tha  argunant  bindings  (arrous)  nay  ba  labeled  to 
reflect  tha  roles  of  tha  argunants  with  respect  to  tha  predicate. 

Labels  osn  ba  prepositions  such  as  "at*,  "by",  and  so  on,  or  they  can  be 
numbers,  where  "1"  raprasants  an  agantiva  argument,  ”2"  an  objective 
argument,  ”3"  a  patient  argument,  and  so  on  (PUlmora,  1966).  Tha 
nominal  arguments  ara  raprasantad  by  the  name  of  the  type  of  tha  object, 
enclosed  in  angled  brackets. 

Individual  student  descriptions  oan  ba  translated  from  the 
propositional  representation  to  this  samantlo  network  representation. 
Figure  2  presents  a  semantic  network  representation  for  student  #3«  It 
presents  the  same  set  of  propositions  given  above  for  this  student, 
shown  against  a  "grayed  out*  background  of  the  composite  representation. 
The  same  method  can  be  used  to  display  the  content  of  task  descriptions 
given  by  other  students,  including  those  students  who  describe  the  task 
much  more  fully.  Figure  3  presents  the  content  of  the  description  of 
the  FLAT-IHTADERS  task  given  by  subject  25,  who  described  the  task  in 
moderate  detail.  Figure  4  presents  the  semantic  network  representation 
of  the  description  given  by  Subject  1,  which  Includes  most  of  the 
propositions  in  the  composite  representation. 
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POSITIOM  (ageot,  objact,  (Instrioiantt  aouroa,  goal))  ■ 

COMPOSITE 

(00^  (agant,  PBO-ACTION  (agant,  InatrtaiaQt ) ) , 

CAUSE  (00^  (•••)»  CHANG^POSj  (objaot,  aouroat  goal)}} 

Invoking  tbla  daflnltlon  In  tha  eoatazt  of  FOSITIONy  (•••)  raaulta 

in  an  azpanaion  baaad  on  tha  daflnltlona  of  POSITION  and  of  FLAT- INVADERS. 

POSITION^  (agantf  <ahip>,  at  <(looatlon)»  ■«> 

COMPOSITE^ 

(DOii  (agant,  PRO-ACTION  (agant,  Inatruaant ) ) , 

CAUSE  (DO^  (...),  CHANGE-POSjj  (<ahlp>,  ,  <looation»)) 

NOT^  (BELOW^  (oraaturaa,  <looatlon»)) 

Evan  this  rapraaantatlon  la  Inooaplata  In  that  It  doaa  not  apaclfy  that 
tha  PRO-ACTION  la  an  Inatanoa  of  POSITIONlng  tha  Joystick  lezer. 

aflarNMotlng  ito  laak  DgaariPUona  at  IntiULvitoRlg 

Students  dlffarad  a  great  deal  In  tha  aaount  of  detail  they 
Included  In  thalr  descriptions  of  tha  tasks.  Soma  students  gaze  zery 
datallad  and  ooaplate  descriptions  of  tha  entire  task,  while  others 
described  only  portions  of  tha  task  In  a  few  words.  For  azaapla, 
student  #3  said 

Thera  are  these  different  figures,  Inzaders.  They're  firing 
down  on  the  blockades.  Tour  little  guy  hides  behind  then.  You 
noze  the  Joystick. 


Translating  this  description  Into  the  representation  format  used 
here  produces  a  definition  for  FLAT- INVADER  something  like  this: 
PLAT-INVADER  (agent) 

COMPOSITE 

(POSITIONS^  (agent,  <Joystlck>), 

BIDE^  (agent,  <shlp>,  behind  <blockades>), 

PIREf  (<oreatues>,  <blookades>)} 


This  rsprsssntstlon  ■skea  usa  of  a  nuabar  of  abbroTlatlons.  Tba 
noBloal  alaaantSy  shovn  bare  as  xwuns  aaolosad  In  anglad  braokats 
(<...>),  bava  a  aora  ooaplaz  undar lying  raprasantatlon.  In  the  actual 
raprasantatlon,  tba  antltlaa  ara  raprasantad  as  aapty  slots  or  aaaory 
looatlons  about  whlob  pradloatlona  suob  as  SPACBSHIPS(Z^^23) 
J0ISTICK(Z^^24)  aada.  This  traataant  of  objaots  paralts  a 
greater  degree  of  unlforalty  In  tba  underlying  raprasantatlon,  since  It 
Is  essentially  Identical  to  the  traataant  of  actions  and  prooassaa. 

In  ordinary  language,  what  the  above  definition  of  PLAT.IRTADBRS 
says  Is  that  this  task  Is  s  ooaposlta  of  asny  actions,  processes,  and 
states.  The  agent  of  PLAT^NVAOERS  aust  kill  spaceships  and  creatures 
with  a  ship,  while  aaklng  the  ship  avoid  tba  oreaturas.  If  tba  agent 
kills  oreaturas,  they  baooae  easier  to  avoid.  The  way  to  kill  tba 
creatures  Is  to  position  the  ship  with  a  joystick  and  then  fire  by 
pushing  a  button  tbat  belongs  to  the  Joystick.  More  points  are  awarded 
for  the  spaceships  than  for  the  creatures.  There  are  s  lot  of  the 
creatures.  The  way  to  avoid  the  creatures  Is  either  to  hid  the  ship 
behind  the  blockades  or  to  aove  the  ship  to  a  location  that  Is  not  below 
any  creatures.  The  creatures  are  arranged  In  rows  and  the  nuaber  of 
points  scored  for  tbea  varies  with  their  row.  The  creatures  fire  at  and 
destroy  the  blockades. 

This  representstlon  Is  not  at  the  level  of  prlaltlves  suob  as  those 
described  In  the  previous  section.  Each  of  the  referenced  predicates  In 
the  definition  has  Its  own  definition,  which  can  be  Invoked  to  further 
specify  the  aeaning  of  FLAT_INVADERS.  (In  fact,  sone  few  of  the  above 
predicates  are  invocations  of  primitives,  such  as  the  Instantiations  of 
the  prlaltlve  predicate  AND.)  For  ezaaple,  consider  the  partial 
Instantiation  of  POSITION  in  the  predication 

POSITIOHy  (agent,  <shlp>,  at  <(looation}>) 

In  the  definition  of  FLAX_INTADERS.  The  generic  definition  of  POSITION 
Is 
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d«TlMd  for  any  ootlon-orlentad  task.  Baasd  on  student  desorlptlons, 
here  Is  a  partial  representation  of  a  oosputer  gaae  slallar  to  the 
aroade  gsM  ■Invaders*.  This  representation  Is  s  relatlTsly  ooaplete 
one,  and  Inoludes  the  najor  knowledge  ooaponents  that  a  noderately 
expert  gsae  player  would  have. 

FLAT_1HTADEHS  (agent)  « 

OOMPOSITB 

(AHD^  (CILLj^  (agent,  iHDj  (<spaoeshlps>,  <oreatures»,  with  <shlp», 
ATOID|^  «shlp>,  <oreatures>)), 

IF-THEN^  (KILL^  (...)»  EASIER j^(ATOID,^  (...))), 

(IILL^  (...),  AHDp 

(POSITION^  (agent,  <Joyatlok»,  PIRE^  (agent,  <shlp>)), 

BTg  (FIREj,  (...),  FOSB^  (agent,  <button>)), 

SlGHER-yALOEDy  «spaoeshlps>,  <oreatures>), 

MANT^  (<oreaturea>), 

METHOD^  (AVOIDj^  (•••)»  OR  (RIOE^  (agent,  <shlp>,  behind  <blookades>), 
(POSITION^  (agent,  <shlp>,  at  <(looatlon)>))), 

ROT^  (BELOH^  (creatures,  <(looatlon)>)), 

?ALOB-BI«ROIf^  «rows», 

INg  (<oreatures>,  (<rows>), 

POSSESS^  «Joystlok>,  <button>), 

CAOSE  (FIRE.  (<oreatures>),  DESTROY.  (<blookades>)}) 

•  *  .8 

Coaiwslte  Seaantlo  Representation  —  FLAT- INVADERS 


The  above  representation  uses  subscripts  to  sake  references  clear. 
For  ezaaple,  the  KILL^  (...)  In  the  line  that  begins  IF-THEN^ 
refers  to  the  saae  action  that  Is  given  above  as 

(EILL^  (agent,  ANDj  (<spaoesblps>,  <oreatures>},  with  <shlp». 
Co-referentlallty  of  nominal  entitles  Is  designated  by  name  alone  In 
this  description.  Subscripts  are  not  nsoessary  In  these  cases,  since 
every  Instance  of  <space8hlps>  In  this  definition,  for  example,  is  meant 
to  refer  to  the  same  set  of  entitles. 
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DBSCBIPTIOHS  OP  DIRAHIC  SKILL  TASKS 


One  of  the  oeatral  problcaa  la  studying  psopls's  knowledge  about 
dynaaio  tasks  Is  deternlnlng  what  the  state  of  that  knowledge  Is.  One 
■ethod  that  oan  be  eaployed  Is  to  ask  a  person  to  describe  what  he  or 
she  knows  about  the  task,  and  to  to  translate  what  Is  said  Into  a 
senantlo  representation,  suoh  as  those  given  above.  To  the  extent 
that  their  report  reflects  knowledge  of  the  task,  the  representation 
will  Bodel  that  knowledge. 

In  order  to  explore  this  approach  to  the  representation  of  task 
understanding,  an  observational  procedure  was  conducted.  TWenty-seven 
undergraduate  students  frca  the  Onlverslty  of  Southern  California  were 
presented  with  a  aeries  of  five  videotaped  exonplars  of  dynaalo  skill 
tasks.  Bach  taped  aegnent  was  fron  two  to  three  minutes  In  length  and 
showed  a  dynamic  task  In  progress.  The  students  watched  the  taped 
segment  and  then  briefly  described  the  task,  referring  to  objects 
displayed  on  the  screen  as  necessary.  Their  descriptions  were 
videotaped  using  a  second  video  recordw*,  and  later  transcribed. 

These  transcriptions  could  then  be  scored  In  a  manner  similar  to  that 
employed  by  Klntscb  (197A). 

The  five  taped  se^ents  displayed  five  tasks  In  action.  One 
segment  showed  a  personal  computer  gome  based  on  the  "Invaders*  arcade 
game.  The  screen  showed  a  pair  of  hands  manipulating  a  Joystick  that 
controlled  the  play  of  the  gome.  Two  other  segments  showed  other 
Joystick-controlled  video  games,  one  of  the  *Pao  Han"  type,  and  one 
baaed  on  "Asteroids."  The  fourth  segment  showed  a  version  of  the 
simulated  Air  Intercept  Controller  task,  described  In  the  following 
section.  The  fourth  sessent  showed  a  pair  of  bands  playing  with  a 
marble  maze  box,  a  dynamic  skill  task  that  does  not  require  the  use  of 
s  computer  or  video  gsme. 

Following  Allen's  representational  format,  a  representation  can  be 


of  a  *8oreen  pointer, ■  Such  lover»lerel  Instaotlatlona  oonatltute 
apeolflo  paraaetere  for  a  generic  sotaMa  at  Inatantlatlon  tlae. 

In  the  generic  Yeralon  of  a  aoheaa,  paraaetera  aay  be  bound  by 
aeleotlonal  reatrlotlona.  For  exaaple,  there  aay  be  a  generic  concept 
for  "aoYlng  a  acreen  pointer*  vhlob  can  apply  to  an  event  only  If  the 
object  paraaeter  la  a  acreen  pointer.  Seleotlonal  reatrlotlona  Halt 
the  range  of  Inatantlatlona  that  can  fill  a  paraaeter  alot  In  a 
generic  acheaa,  but  they  are  auoh  leaa  apeclflo  than  actual 
Inatantlatlona. 

The  prooeaa  of  Inatantlatlon  la  often  ooablned  with  a  proceaa  of 
acheaa  deooapoaltlon  or  ezpanalon.  At  the  tlae  that  a  predicate  la 
Inatantlated,  aoae  or  all  of  the  eleaenta  of  Ita  definition  aay  alao 
be  Inatantlated.  Theae  Inatantlated  predlcatea  aay  theaaelvea  have 
definitional  coaponenta  that  can  further  be  Inatantlated,  and  ao  on. 
Thla  ezpanalon  proceaa  la  not  a  neoeaaary  part  of  every  Inatantlatlon 
of  a  acheaa.  Ordinarily  ezpanalon  or  decoapoaitlon  will  not  take 
place  or  vlll  be  quite  ahallov.  The  depth  of  deccapoaltlon  during 
Inatantlatlon  refleota  the  depth  of  prooeaalng  that  the  concept 
recelvea  vben  It  la  activated. 

Decoapoaitlon  can  be  auapended  during  the  Inatantlatlon  proceaa 
and  later  reactivated,  due  to  further  proceaalng  on  the  topic. 

Probable  ocoaalona  for  additional  acheaa  ezpanalon  Include  the 
Inatantlatlon  of  neu  eleaenta  that  have  paraaetera  that  are  already 
Inatantlated,  but  not  yet  expanded.  The  additional  activation  due  to 
the  new  "calling*  acheaa  aay  be  enough  to  prompt  the  expansion  of  such 
a  previously  Instantiated  predicate. 

Another  prlaltlve  process  that  can  be  applied  to  all 
representation  eleaenta  la  ooaparlson.  Comparison  processes  aust  be 
able  to  determine  Identity,  non-ldentlty,  function  equivalence 
(equality),  and  Inequality.  Related  processes  are  responsible  for 
searching  for  particular  representation  elements  or  complexes  of 
elements. 
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a  representation  that  the  sore  ooaplez  predloates  that  are  oonatruoted 
froB  then  do.  Bowerer,  there  are  two  respects  in  whioh  the  priaitives 
are  distinct.  First,  they  oannot  be  expanded  or  "deooaposed”  into  a 
■ore  atOBistio  representation,  as  oan  oonplez  predicates  or  schemata. 
Second,  they  haze  a  special  status  in  that  a  computer-based  systeB 
that  Bakes  use  of  this  representation  must  haze  pre-defined  processes 
that  are  prepared  to  deal  directly  with  the  prlaitizes,  though  not 
with  Bore  ooaplez  eleaents.  For  example,  priaitize  truth-zalue 
operators  oan  check  the  bounds  of  two  tiae  interzals  to  deteraine 
whether  the  DURING  predicate  applies. 

PrlaUtlTfl  fTQcoswa  Anl  Ihft  Reprcaantatlpn 

The  Bost  basic  process  that  acts  on  the  data  that  constitute  a 
representation  is  instantiation.  This  is  the  process  that  Bakes  a 
speolflo,  oontext-eabedded,  and  particularized  copy  of  a  generic 
schema.  This  copy  represents  a  record  of  a  portion  of  the  nental 
aotlzity  acooBpanylng  a  decision  and  its  subsequent  action.  For 
example,  the  generic  concept  of  "nozing  an  object*  must  be 
distinguished  from  a  specific  Beaory  for  *BOzlng  a  pointer  on  a  screen 
froB  the  lower  left  corner  to  the  upper  right  corner  at  11:42  A.M.  on 
Nozeaber  23. *  The  latter  concept  is  a  specific  instantiation  of  the 
former. 


An  instantiation  or  specific  copy  differs  froB  the  generic 
orlginiiJ  in  sezeral  respects.  An  instantiated  copy  of  a  predicate  is 
part  of  a  network  of  linked  instantiations.  For  example,  the 
instantiation  for  Bozlng  the  screen  pointer  on  Nozeaber  23  may  be 
linked  to  an  instantiation  for  the  appearance  of  a  new  icon  on  the 
screen  iBaediately  before.  (This  is  especially  likely  if  the  pointer 
Bozeaent  was  a  response  to  the  new  icon  appearance.)  A  glzen 
instantiation  has  other  instantiations  linked  to  it  as  parameters,  and 
it  is  typically  a  parameter  for  some  hlgher-lezel  instantiation  of  a 
different  generic  schema.  The  "object”  parameter  in  this  particular 
case  of  "mozlng  an  object”  is  an  instantiation  of  the  genrlc  concept 


COMFOTER-GENERATBD  REPRESENTATIOHS  OP  STUDENT  KNOWLEDGE 
BASED  GR  TASK  PERFORMANCE 

Ideally,  an  effective  atudent  knowledge  representation  construction 
systea  will  build  representations  based  on  performance  on  a  task.  To 
explore  the  feasibility  of  such  representation  construction,  It  Is 
necessary  to  use  a  dynamic  skill  task  that  the  computer  can  monitor 
closely.  For  this  purpose,  we  selected  portions  of  a  simulated  Air 
Intercept  Controller  (AIC)  task,  exploiting  our  previous  experience  In 
developing  experimental  simulation  training  systems  In  this  domain 
(Munro,  Towns,  A  Fehllng,  1981;  Munro,  Fehllng,  Blais,  A  Towns,  1981; 
Munro,  Towns,  Cody,  A  Abramowskl,  1982;  Munro,  Fehllng,  A  Towns,  In 
press). 

Ito  AIC.  Trackiag  laak 

In  our  previous  research  on  representing  dynamic  task  knowledge 
and  skills,  we  have  used  a  task  simulation  called  the  AIC  tracking 
task.  The  student  uses  a  pointing  device  (Joystick,  trackball,  or 
mouse)  to  position  symbols  on  blips  that  appear  on  a  simulated  radar 
screen.  When  a  blip  appears  on  the  screen  (after  a  radar  sweep),  the 
student  puts  a  symbol  on  the  blip  as  soon  as  possible.  In  Figure  5A, 
the  student  has  labeled  a  new  blip  with  the  symbol  *1”. 

In  the  AIC  tracking  task,  a  simulated  tracking  computer  moves  the 
symbols  on  a  path  established  by  the  student.  Ideally,  this  path  should 
track  the  movements  of  the  blips  associated  with  the  symbols.  In  order 
to  establish  a  correct  track,  students  must  position  the  symbol  a  second 
time,  after  a  second  radar  sweep.  The  two  locations  are  used  by  the 
tracking  computer  to  establish  a  path  for  the  symbol  to  follow  on 
subsequent  updates.  In  5B,  the  student  has  labeled  the  blip  again  In 
the  new  location.  In  5C,  the  blip  has  changed  course,  and  the  student 
has  relabeled  It  once  again  In  order  to  establish  a  new  correct  path  for 
the  symbol  (”1*). 
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Students  must  observe  end  respond  to  s  nuaber  of  events  that  can 
ooour  during  radar  sweeps  In  this  task.  In  Figure  6A,  a  new  blip  has 
appeared  and  been  labeled  before  the  next  radar  update.  In  6B,  the  blip 
has  been  labeled  again,  thereby  establishing  a  new  correct  path.  In 
Figure  6C,  however,  the  blip  has  changed  velocity,  so  the  computed 
tracking  path  Is  Incorrect.  Ihe  student  must  recognize  this  condition 
and  relabel  the  blip  again  In  order  to  Inep  the  computed  track  on  the 
oourse  of  the  blip. 

Formalizing  AIC  Taaka 

From  only  the  elements  described  above,  many  Important  elements  of 
the  AIC  task  can  be  represented  formally.  For  example,  one  key  (and 
surprisingly  complex)  event  In  AIC  tracking  Is  responding  to  a  change  of 
direction  of  a  prevlously^ldentlfled  blip  (a  *headlng  jink*).  The 
change  of  direction  characteristic  would  be  represented  with  a  function 
of  the  form 

CRANGE-DIRECTI0H(BLIP,angle1 ,angle2) 

To  assert  that  a  particular  Identified  blip  (BLIP1)  changed 
direction  diurlng  some  partlo\aar  time  Interval  (T3),  we  would  say 

0CaiR(CHAIIGE-0IRECTI0N(BLIP1  ,OBGRBESt  ,DEGREES2) ,  T3) 

and  to  determine  if  BLIP1  was  previously  Identified  we  could  evaluate 
the  expression 

0CaJR(IDBNTIFIED<BLIP1,T2))  A  BEF0RE(T2,T3) 


which  states  that  BLIP1  was  IDEMTIPIED  during  Interval  T2,  and  T2  is 
BEFORE  T3. 
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The  proposed  repreaentstion  systea  will  aeke  use  of  decoaposltlon 
aethoda  In  the  course  of  derlTlng  Inferences.  IDERTIFT  has  deccaposable 
structure  that,  when  expanded,  aakes  explicit  the  role  of  an  agent  (the 
student)  In  an  action  that  Identifies  a  blip  bj  assigning  a  syabol  to  It. 
To  deteralns  If  BLIP1  was  IDENTIFIED  during  T2,  we  would  refer  to  the 
prlaltlve  definition  of  IDENTIFIED  to  ascertain  whether  It  was  satisfied 
DORINQ  T2. 

An  laportant  property  of  this  representation  systea  Is  that  It  can 
handle  non-contlnuoua  processes.  In  addition  to  events  and  properties. 
Thus  an  Intelligent  tutorial  systea  could  recognize  that  a  learner  Is 
'tracking'  a  blip,  even  though  that  activity  night  be  Interrupted  at 
tlaes  to  take  care  of  other  tlae-crltleal  needs.  Of  course  It  would  be 
necessary  to  define  explicitly  what  constitutes  perfornance  of  the 
process.  For  exaaple  we  night  say  that  the  process  P,  such  as  tracking, 
occurs  over  tlae  Interval  T1  If  there  Is  no  time  Interval  T2,  DURING  T1 
that  Is  greater  than  T3  (a  reference  Interval),  In  which  the  property  of 
tracking  Is  not  true. 

TRACKING(TI)  Is  defined  as 

NOT  12  I  0CCDR(N0T(ATTEND_TRACK),T2)  &  DDRING(T2,T1)  A  T2>T3 
where  ATTEND_TRACK  Is  defined  In  terns  of  student  actions  that 
reflect  attention  to  the  position  of  the  blip. 

If  T3  were  20  seconds  In  duration,  then  any  Interruption  In 
tracking  greater  than  20  seconds  would  temlnate  the  tlae  period 
during  which  tracking  was  being  perforaed.  If  tracking  resumed, 
another  tlae  period  would  be  Initiated. 

Another  universal  aspect  Is  the  use  of  an  "Interactive  situation 
skeleton*  that  is  also  built  out  of  Allen's  primitive  building  blocks. 
This  seaantlc  structure  Is  a  kind  of  universal  schema  for  Interactive 
dynamic  skill  tasks.  One  of  the  results  of  our  current  ONR  research 
project  has  been  the  specification  of  this  domain-independent  expression 


of  the  top  level  structure  of  sn  interactive  dynaalo  skill  task.  At  the 
highest  level  of  this  representation,  a  dynaalo  skill  consists  of  an 
ggSJlL  cauaina  prooeasea  in  response  to  a  task  event,  i.e. : 

OCCDRRlNG(IHlTIATE(OBSEBVE(agent,event ) ,ACADSE(agent, occurence )), t) 

Here  the  ACAOSE  clause  represents  the  student's  reaction  to  the 
observed  event. 

Tasks  of  Interest,  such  as  the  AIC  tracking  task,  have  multiple 
objectives  Mblob  must  be  continually  and  siaultaneously  considered  by 
the  performer.  Thus  the  OCCORRENCE  of  AIC  tracking  is  defined  as  a 
ooabinatlon  of  positive  objectives,  and  possibly  the  avoidance  of 
negative  events.  Just  how  these  ooapeting  factors  are  assigned 
levels  of  priority  is  a  natter  to  be  explored  in  future  research. 

When  an  intelligent  tutor  is  created  for  use  in  a  particular 
slaulation  training  environment,  most  of  the  high-level  representation 
components  for  that  task  will  fit  into  slots  in  the  interactive 
situation  skeleton. 

The  system  provides  object-oriented  representation  of  domain- 
specific  knowledge  for  dynamic  interactive  tasks.  Object-oriented 
composition  systems  have  the  advantages  that  they  require  less 
"intelligence”  or  expertise  on  the  part  of  the  user  than  do  traditional 
simulation  building  methods  (Boring,  1979;  Hollan,  1983;  Munro,  1984; 
Towns  A  Munro,  1984;  Scbneiderman,  1982).  The  user  of  this  semantic 
object  composition  system  is  a  process  in  the  intelligent  tutor,  the 
process  responsible  for  detecting  evidence  for  particular  representation 
components  and  for  building  student  representations  out  of  those 
components. 
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The  original  Teralona  of  the  slaulated  AlC  task  dereloped  at 
Behavioral  Technology  Laboratorlea  were  iapleaented  In  Apple  Paaoal  on 
Apple  //  oomputers.  In  a  new  aet  of  obaenratlonal  atudlea,  a  alapllfled 
▼eralon  of  the  AIC  taak  vaa  created  that  eaphaalzed  a  portion  of  the 

taak,  the  "hooking”  prooeaa,  by  which  bllpa  on  the  radar  acreen  are  • 

labeled.  The  new  veralon  of  the  taak  (alao  Implemented  on  Apple  //a) 

waa  uaed  to  gather  performance  data.  The  purpoae  of  atudlea  with  thla 

taak  waa  to  chooae  a  aubaet  of  the  AIC  taak  that  required  dynamic  akllla 

but  that  waa  atUl  amenable  to  complete  repreaentatlon. 

Fifteen  undergraduate  atudenta  at  the  Onlveralty  of  Southern 
California  participated  In  thla  atudy  for  courae  credit.  The  atudenta  • 

were  preaented  with  a  brief  videotape  that  Introduced  the  AIC  hooking 
taak.  Then  they  worked  through  a  aerlea  of  ten  progreaalvely  more 
difficult  practice  exerclaea.  Theae  ezerclaea  were  adaptive,  ao  that 
the  degree  of  difficulty  depended  on  the  aklll  with  which  a  atudent  ^ 

performed  the  taak.  The  atudenta  exhibited  great  variety  In  their 
performance.  Some  quickly  attained  near-expert  performance  levela, 
while  othera  ahowed  marked  deflclenclea  In  one  or  more  aapecta  of  the 
taak.  Ho  alngle  model  of  atudent  underatandlng  of  taak  requlrementa  and 
atrateglea  could  have  accounted  for  all  the  different  performancea 
obaerved.  Intervlewa  with  the  atudenta  revealed  that  they  had  quite 

dlaparate  modela  of  the  taak  and  that,  for  particular  atudenta,  aapecta  • 

of  performance  could  be  related  to  the  content  of  their  deacrlptlona. 

A  atudent  repreaentatlon  ayatem  that  dependa  on  introapective 
analyaea  of  the  meaning  of  atudent  atatementa  would  provide  an  * 

unreliable  aet  of  repreaentatlona.  Vblle  acme  atudent  conmenta 
correlate  well  with  obaerved  performance  behavlora,  moat  behavior  la  not 
well  reflected  In  the  deacrlptlona.  What  la  required  la  a  ayatem  that  ^ 

bullda  repreaentatlona  of  atudent  knowledge  based  on  observed  student 
behavior. 
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Building  such  rspressntstlons  as  a  dynaalo  task  is  carried  out  is 
ODS  of  goals  of  the  current  research  effort.  Two  largely  autonomous 
processes  reside  in  a  single  computer  system  that  both  provides  a  task 
environment  and  represents  the  student's  understanding  of  the  task.  The 
lie  hooking  task  was  rewritten  In  Interllsp-D  on  a  Xerox  1108  Scientific 
Information  Processor.  A  system  for  representing  aspects  of  knowledge 
about  the  task  has  been  Implemented,  based  on  a  set  of  generic  schemata 
for  dynamic  skill  primitives.  Vhen  these  schemata  are  activated  during 
an  Interactive  task  session,  they  build  a  semantic  network  that 
represents  the  events  of  the  session. 

The  AIC  hooking  task  on  the  Xerox  1108  Is  Implemented  as  a  process 
bound  to  a  set  of  windows  that  contain  the  simulated  radar  screen, 
scoring  Information,  and  performance  feedback  (see  Figure  7)*  The  blips 
change  location  at  periodic  Intervals  that  represent  the  results  of  new 
radar  sweeps. 

As  events  occur  In  the  simulation,  a  second  process  evaluates  those 
events  — >  the  simulation  events  and  the  student  responses  —  In  terms  of 
a  pre-deflnsd  "vocabulary*  of  conceptual  representations.  The  elements 
of  this  semantic  vocabulary  are  LISP  functions  that  play  the  role  of 
schemata  or  frames.  The  schemata  are  activated  by  events  In  the  task 
simulation  and  apply  tests  to  events  to  determine  whether  they  apply. 
When  a  schema  finds  that  It  does  apply.  It  creates  an  Instance  node  in  a 
semantic  network  that  represents  an  Instantiation  of  that  concept. 

The  representation  of  student  knowledge  about  the  AIC  hooking  task 
takes  two  forms  in  this  system.  Generic  knowledge  is  represented  by 
schemata  written  In  LISP.  Specific  knowledge  Is  represented  by  a 
semantic  network  created  by  and  linked  to  the  generic  schemata.  When  a 
simulated  radar  sweep  takes  place,  a  number  of  generic  knowledge 
elements  are  activated.  For  example,  LOCATED-AT  Is  activated  for  each 
object  on  the  radar  screen.  This  creates  a  number  of  new  Instances  of 
LOCATED-AT  in  the  network.  These  Instantiations  of  LOCATBD-AT  represent 
the  user's  knowledge  about  the  locations  of  objects  at  the  end  of  a 
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Figure  7 


radar  aveap.  In  a  Sanaa,  tba  activations  of  LOCATED-AT  sarva  as  a 
functional  nodal  of  tha  act  of  parcalvlng  tha  locations  of  tha  objaots. 

Otbar,  nora  top-down,  scbanata  ara  also  aotlvatad  when  a  radar 
swaap  takas  plaoa,  suob  as  a  saarcb  for  Instanoas  of  DNLABELED  blips  on 
tba  scraan.  (Sona  studants  follow  tba  stratagy  of  noticing  which  blips 
arc  unlabalad  after  a  radar  swaap,  and  than  rahook  than.)  UILABELED  Is 
a  oonplaz  sebena  that  aotlvatas  otbar  scbanata,  suob  as  NEAR  and  ANT. 
Thus,  tha  saarcb  for  unlabalad  blips  nay  result,  not  only  In  the 
addition  of  Instantiations  of  OILABELED  to  tha  raprasantatlonal  network, 
but  also  In  tba  Instantiations  of  otbar  scbanata,  such  as  NEAR. 

Figure  8  presents  a  portion  of  a  raprasantatlonal  network 
Innadlataly  after  a  swaap  has  taken  place.  This  figure  represents  a 
student's  understanding  of  sons  of  tha  spatial  relationships  that  hold 
anong  objaots  on  tha  soraan.  Node  AOO36,  for  azanpla  represents  a 
nanory  for  tba  fact  that  Bllpl  Is  at  a  particular  'ocatlon  on  the 
scraan  (55*  A73)*  It  Is  an  Instantiation  of  tba  LOCATED-AT  sebena. 

Node  AOO3A  la  a  raprasantatlon  of  Bllpl,  an  Instantiation  of  tha  BLIP 
sebena.  And  A0035  Is  tha  scraan  location,  an  Instantiation  of  the 
LOCATION  sebena. 

In  Figure  8,  tha  nodes  are  raprasantad  by  ovals  surrounding  the 
node  Identification  (a  string  such  as  AOO36)  and  the  nana  of  the  schema 
of  which  It  Is  an  Instantiation.  This  use  of  tha  schema  name  In  an 
oval  la  a  graphic  convention  for  a  pointer  labeled  "Instance"  from  tha 
node  to  tha  generic  sobama.  Axx)thar  graphic  abbreviation  used  in  the 
figure  Is  that  each  pointer  shown  actually  represents  two  pointers,  one 
tba  Inverse  of  that  displayed  In  tha  figure.  Thus,  an  "object"  pointer 
from  AOO36  to  AOO34  Is  matched.  In  tba  Implatentatlon  of  the 
raprasantatlon,  by  an  "objact-of"  pointer  from  AOO3A  to  A0036. 

Tba  pointers  of  tba  representational  network  are  Implemented  as 
properties.  Each  node  has  a  sat  of  properties  with  property  values  that 
ara  the  nodes  pointed  to.  Generic  elements  also  have  property  lists. 
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”Instano«*  properties  link  generic  soheoats  to  the  specific  elements  In 
the  representational  netvork. 

Because  the  generic  elements  are  LISP  functions,  a  simple  question 
ansHerlng  facility  Is  Inherent  In  the  representational  system.  The  AIC 
simulation  can  be  suspended  at  any  point  and  a  query  window  opened  on 
the  screen,  as  In  Figure  10.  The  query  window  permits  a  user  to  enter 
standard  schemata  In  a  mode  that  returns  a  textual  result.  For  example, 
the  query 

(HEAR  (BLIP  BLIP1)  (SIMBOL  1)  CORRENT-TIMB) 
will  return  the  node  (A0042)  that  represents  the  perception  of  the 
nearness  of  Blip  1  and  Symbol  1.  (If  Blip  1  and  Symbol  1  were  not  In 
fact  near  each  other,  then  the  query  would  return  NIL.)  In  Figure  9,  a 
query  window  has  been  opened,  suspending  the  AIC  simulation  task. 

Pircctioaa  Future  Development 

The  work  done  thus  far  has  laid  the  foundations  for  a  system  that 
automatically  constructs  models  of  student  understanding  of  dynamic 
skill  tasks.  Such  a  system  would  work  In  conjunction  with  a  task 
simulator  that  would  provide  students  with  training  practice. 
Observational  evidence  suggests  that  dynamic  skill  task  knowledge  is 
quite  variable.  An  effective  Intelligent  trainer  would  benefit  from  the 
availability  of  an  accurate  model  of  student  knowledge,  built  on  the 
basis  of  student  Interactions. 

Such  an  automatic  knowledge  representation  system  would  require  a 
large  library  of  generic  schemata  representing  the  different  ways  that 
task  performers  can  view  or  understand  aspects  of  the  task  domain.  For 
example,  there  might  be  several  different  schemata  for  NEAR, 
representing  different  performers'  conceptions  of  how  close  two  elements 
must  be  for  them  to  be  considered  near  to  each  other.  As  a  session 
progresses,  evidence  (in  the  form  of  performer  responses  to  simulated 
events)  will  accumulate  In  support  of  certain  schemata  and  against 
others.  The  set  of  supported  scheaiata  will  comprise  a  model  of  the 
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student's  understanding  of  the  task. 

Onoe  such  a  student  aodel  has  been  created.  It  can  be  used  to  guide 
tutorial  Interaotlons.  The  system  will  have  access  to  an  Ideal  model  of 
task  knowledge,  which  can  be  compared  with  the  current  student  model.  It 
remains  to  be  determined  what  are  the  moat  effective  methods  for 
producing  tutorials  using  the  current  student  model  and  the  Ideal  model. 
An  Interesting  possible  method  would  be  to  demonstrate  the  differences 
In  the  performance  of  the  task  to  a  student  by  simulating  the 
performance  of  an  expert,  using  the  Ideal  model,  comparing  that 
performacne  with  that  of  the  student  model.  It  Is  even  conceivable  that 
some  simple  verbal  explanations  could  be  generated  by  processes  that 
compare  the  Ideal  and  the  student  schemata. 
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1  Dr.  Jaaes  NcNichael 
Navy  PersonnelfiAD  Center 
San  Diego,  CA  92152 

1  Dr  Williae  Nontague 
NPRDC  Code  13 
San  Diego,  CA  92152 


I  Technical  Director 
Navy  Personnel  RAD  Center 
San  Diego,  CA  92132 
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Navy 

1  Office  of  Naval  Research 
Code  433 

800  N.  Buincy  SStreet 
Arlington,  VA  22217 

1  Psychological  Sciences  Division 
Code  442 

Office  of  Naval  Research 
Arlington,  VA  22217 

1  Director 

Engineering  Psychology  Prograe 
Code  442EP 

Office  of  Naval  Research 
800  N.  Buincy  Street 
Arlington,  VA  22217 

1  Organizational  Effectiveness 
Research  Prograe,  Code  4^2QE 
Office  of  Naval  Research 
Arlington,  VA  22217 

1  Psychologist 
ONR  Branch  Office 
1030  East  Green  Street 
Pasadena,  CA  91101 

1  Or.  8il  Ricard 
Code  1711 
NTEC 

Orlando,  FL  32813 

1  Milliaa  Rizzo 
Code  712  NTEC 
Orlando,  FL  32B13 

I  Dr.  Paul  B.  Schr.eck 
Office  of  Naval  Research 
Code  433 
BOO  N.  Buincy 
Arlington,  VA  22217 


Navy 

1  Dr.  Richard  Sorensen 
Navy  Personnel  RID  Center 
San  Diego,  CA  921S2 

1  Dr.  Thoeas  Sticht 
Navy  Personnel  RAD  Center 
San  Diego,  CA  921S2 

1  Dr.  Martin  A.  Tolcott 
Leader,  Psychological  Sciences  Division 
Office  of  Naval  Research 
800  N.  Buincy  St. 

Arlinsgon,  VA  22217 

1  Dr.  Jaaes  Tueeddale 
Technical  Director 
Navy  Personnel  RAO  Center 
San  Diego,  CA  92152 

1  Roger  Neissinger-Baylon 
Departaent  of  Adainistrative  Sciences 
Naval  Postgraduate  School 
Monterey,  CA  93940 

1  Dr.  Douglas  Net z el 
Code  12 

Navy  Personnel  RAD  Center 
San  Diego,  CA  921S2 

1  Or.  Hal  lace  Hulfeck,  III 
Navy  Personnel  RAD  Center 
San  Diego,  CA  92152 

1  Or.  Steven  Zornetzer 
Associate  Director  for  life  Sciences 
Office  of  Naval  Research 
BOO  N.  Buincy  St. 

Arlington,  VA  22217 


1  Dr.  Michael  G.  Shafto 
ONR  Code  442PT 
SCO  N.  Buincy  Street 
Arlington,  VA  Z22I7 

1  Dr.  Alfred  F.  Saode 
Senior  Scientist 
Code  7B 

Naval  Training  Eguioaent  Center 
Orlando,  FL  32813 
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Any  Any 

1  iKhnicil  Director 
U.  S.  Any  Research  Institute  lor  the 
Behavioral  and  Social  Sciences 
SOOi  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Or.  Beatrice  J.  Farr 
U.  S.  Any  Research  Institute 
3001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Hilton  S.  Katz 
U.S.  Any  Research  Institute 
3001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Harold  F.  O’Neil,  Jr. 

Director,  Training  Research  Lab 
Arty  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Coeeander,  U.S.  Aray  Research  Institute 
lor  the  Behavioral  I  Social  Sciences 
ATTN:  PERl-SR  (Or.  Judith  Orasanu) 

3001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  Dr.  Ray  Perez 
3001  Eisenhower  Avenue 
PERMl 

Alexandria,  VA  22333 

I  Joseph  Psotka,  Ph.D. 

ATTN:  PERI-IC 
Any  Research  Institute 
3001  Eisenhower  Ave. 

Alexandria,  VA  22333 

1  Sr.  Robert  Saseor 
U.  S.  Aray  Research  Institute  lor  the 
Behavioral  and  Social  Sciences 
3001  Eisenhower  Avenue 
Alexandria,  VA  22333 

1  OR.  ROBERT  J.  SEIDEL 
US  Any  Research  Institute 
3001  Eisenhower  Ave. 

Alexandria,  VA  22333 


1  Or.  Zita  n.  Sieutis 
Chi el.  Instructional  Technology 
Systees  Area 
ARI 

3001  Eisenhower  Avenue 
Alexandria,  VA  22333 
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Air  Forci 

1  U.S.  Air  Force  Olficc  of  Scientific 
Research 

Life  Sciences  Directorate,  NL 
Bolling  Air  Force  Base 
Mashington,  DC  20332 

1  Or.  Killiae  E.  Alley 
AFHRL/nOT 
Brooks  AFB 
,  TI  78233 

1  Dr.  Earl  A.  Alluisi 
HO,  AFHRL  lAFSC) 

Brooks  AFB,  TI  7B233 

1  Bryan  Dallean 
AFHRL/LRT 

LoMry  AFB,  CQ  80230 

3  Or.  Sherrie  Sott 
AFHRL/ROOJ 
Brooks  AFB 
,  TI  78233 

1  Or.  Patrick  Kyllonen 
AFHRL/HOE 

Brooks  AFB,  TI  7823! 

1  Hr.  Bill  Neale 
HO  ATC/TTA 
Randolph  AFB 
,  TI  78148 

1  Or.  Lattrence  E.  Reed 
Research  Psychologist 
AFHRL/LRG 
Nrijht- 

Patterson  AFB 
,  OH  43433 

1  Or.  John  Tangncy 
AFOSR/NL 

Bolling  AFB,  DC  20332 

1  Dr.  Joseph  Yasatukc 
AFHRL/LRT 

Loery  AFB,  CO  80230 


Departeent  of  Defense 

1  Dr.  Craig  I.  Fields 
Advanced  Research  Projects  Agency 
1400  Hilson  Blvd. 

Arlington,  VA  22209 

1  Military  Assistant  for  Training  and 
Personnel  Technology 
Office  of  the  Under  Secretary  of  Defens 
for  Research  It  Engineering 
Rooe  3C129,  The  Pentagon 
Mashington,  DC  20301 

1  Hajor  Jack  Thorpe 
DARPA 

1400  Milson  Blvd. 

Arlington,  VA  22209 

1  Dr.  Robert  A.  Misher 
U.S.  Aray  Institute  for  the 
Behavioral  and  Social  Sciences 
3001  Eisenhoeer  Avenue 
Aleiandria  ,  VA  22333 
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Civilian  Agrncits 

1  Dr.  Patricia  A.  Butltr 
NIE'BRN  Bldg,  Stop  •  7 
1200  19th  St.,  NM 
Washington,  DC  20208 

1  Hr.  Jia  Carey 
Coast  Guard  6*PTE 
2100  Second  St.,  S.W. 

Washington,  DC  20S93 

1  Dr.  Arthur  Melud 
724  Broun 

U.  S.  Dept,  of  Education 
Washington,  DC  20208 

1  Dr.  Andreu  R.  holnar 
Office  of  Scientific  and  Engineering 
Personnel  and  Education 
National  Science  Foundation 
Washington,  DC  205S0 

1  Or.  Douglas  Pearse 
DCIEH 
Bon  2000 

OounsvieH,  Ontario 
CANADA 

t  Sr.  Dudy  Segal 
NIE 

1200  19th  Strnt  N.N. 

Nail  Stop  i 
Washington,  DC  20208 

1  Dr.  Raisay  N.  Se’den 
National  Institute  of  Education 
1200  19th  St.,  NW 
Washington,  DC  20208 

1  Dr.  Sylvia  A.  S.  Shafto 
National  Institute  of  Education 
1200  19th  Street 
Nail  Stop  i 
Washington,  DC  20208 

1  Dr.  Frederick  Steinheiser 
CIA-ORD 
il2  Aees 

Washington,  DC  20D03 

1  Dr.  Joseph  L.  Young,  Director 
Neeory  \  Cognitive  Processes 
National  Science  Foundation 
Washington,  DC  20S50 


Private  Sector 

1  Dr.  John  R.  Anderson 
Oepartaeot  of  Psychology 
Carnegie-Rfllon  University 
Pittsburgh,  PA  13213 

1  Patricia  Baggett 
Departeent  of  Psychology 
University  of  Colorado 
Boulder,  CD  80309 

1  Eva  L.  Baker 
Director 

UCLA  Center  for  the  Study  of  Evaluation 
143  Roore  Hall 

University  of  California,  Los  Angeles 
Los  Angeles,  CA  90024 

1  Mr.  Avron  larr 
Departeent  of  Coaputer  Science 
Stanford  University 
Stanford,  CA  94303 

I  Or.  Isaac  Be jar 
Educational  Testing  Service 
Princeton,  NJ  08450 

1  Gordon  N.  Dover 
Departeent  of  Psychology 
Stanford  University 
Stanford,  CA  943G6 

1  Or.  John  S.  Broun 
XEROI  Palo  Alto  Research  Center 
3333  Coyote  Road 
Palo  Alto,  CA  94304 

1  Dr.  Glenn  Bryan 
6208  Pee  Road 
Bethesda,  MD  20817 

1  Dr.  Bruce  Buchanan 
Departeent  of  Coaputer  Science 
Stanford  University 
Stanford,  CA  «43C'3 

1  Or.  Jaiae  Carbonell 
Carnegte-Rellon  University 
Departeent  of  Psychology 
Pittsburgh,  PA  15213 

1  Dr.  Pat  Carpenter 
Departeent  of  Psychology 
Carnegie-Nellon  University 
Pittsburgh,  PA  15213 
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Private  Sector 

1  Or.  Nicheline  Chi 
Learning  R  k  D  Center 
University  of  Pittsburgh 
39:.9  O’Hara  Street 
Pittsburgh,  PA  15213 

1  Dr.  Milliaa  Clancey 
Departient  of  Coiputer  Science 
Stanford  University 
Stanford,  CA  9(306 

1  Sr.  Nichael  Cole 
University  of  California 
at  San  Diego 

Laboratory  of  Coeparative 
Huean  Cognition  •  D003A 
La  Jolla,  CA  92093 

1  Dr.  Allan  N.  Collins 
Bolt  .uranek  6  Neuian,  Inc, 

50  Boulton  Street 
Caibridge,  HA  02138 

1  Dr,  Lynn  A,  Cooper 
LRDC 

University  of  Pittsburgh 
J?:?  O’Hara  Street 
Pittsburgh,  PA  15213 

1  Lee  Cronbach 
16  Laburnue  Road 
Atherton,  CA  94205 

1  Dr.  Jeffrey  Clean 
University  of  California,  San  Diego 
Departaent  of  Linguistics 
La  Jolla.  CA  92093 

1  Dr.  Anders  Ericsson 
Departaent  of  Psychology 
University  of  Colorado 
Boulder,  CO  30309 

1  O'".  Paul  Feltovich 
Departaent  of  Nedical  Education 
Southern  Illinois  University 
School  of  Nedicine 
P.O.  Bo«  3926 
Springfield,  IL  62708 


Private  Sector 

1  Hr.  Kallace  Feurzeig 
Departient  of  Educational  Technology 
Bolt  Beranek  6  Neaian 
to  Houlton  St. 

Caabridge,  NA  02238 

I  Or.  Dexter  Fletcher 
University  of  Oregon 
Departient  of  Coaputer  Science 
Eugene,  OR  97403 

1  Or.  John  R.  Frederiksen 
Bolt  Beranek  It  Neaaan 
50  Boulton  Street 
Caabridge,  NA  02138 

1  Dr.  R.  Eduard  Eeiselaan 
Departaent  of  Psychology 
University  of  California 
Los  Angeles,  CA  90024 

1  Dr.  Bichael  Senesereth 
Departaent  of  Coiputer  Science 
Stanford  University 
Stanford,  CA  943C5 

1  Dr.  Dedre  Sentner 
Psychology  Departient 
University  of  Illinois 
603  East  Daniel  Street 
Chaapaign,  IL  61820 

1  Dr.  Don  Sentner 

Center  for  Huean  Inforiation  Processing 
University  of  California,  San  Diego 
La  Jolla,  CA  92093 

1  Dr.  Robert  Blaser 

Learning  Research  6  Developaent  Center 
University  of  Pittsburgh 
3939  O’Hara  Street 
PITTSBURGH,  PA  15260 

1  Dr.  Josph  Goguen 
SRI  International 
333  RavensMOod  Avenue 
Benlo  Park,  CA  94025 

1  Or.  Daniel  Sopher 
Faculty  of  Industrial  Engineering 
6  Banageaent 
TECHNION 
Hai'a  32000 
ISRAEL 
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Privatt  SKtor 

1  Dr.  Bert  firm 
Johns  Hopkins  University 
Departeent  of  Psychology 
Charles  It  34th  Street 
Baltieore,  HD  2121B 

1  Or,  Jaws  6.  Sreeno 
University  of  California,  Berkeley 
Departeent  of  Education 

Berkeley  ,  CA 

1  Dr.  Henry  H.  Halff 
Halff  Resources 
491B  33rd  Road,  North 
Arlington,  VA  22207 

1  Dr.  Barbara  Hayes-Roth 
Departeent  of  Cosputer  Science 
Stanford  University 
Stanford,  CA  9S303 

1  Dr.  Joan  I.  Haller 
Sraduate  Broup  in  Science  and 
Natheeatics  Education 
c/o  School  of  Education 
University  of  California 
Berkeley,  CA  9^720 

1  Dr.  Earl  Hunt 
Dept,  of  Psychology 
University  of  Nashington 
Seattle,  NA  9B10S 

1  Dr,  Zachary  Jacobson 
Bureau  of  Hanageeent  Consulting 
36S  Laurier  Avenue  Nest 
Ottaua,  Ontario  KIA  OSS 
CANADA 

1  Dr.  Narcel  Just 
Departeent  of  Psychology 
Carnegie-Nellon  University 
Pittsburgh,  PA  15213 

1  Dr.  Deeetrios  Karis 
Departeent  of  Psychology 
University  of  Illinois 
603  E.  Daniel  Street 
Chaepaign,  It  61320 


Private  Sector 

1  Dr.  Scott  Kelso 
Haskins  Laboratories,  Inc 
270  CroM  Street 
New  Haven,  CT  06510 

1  Dr.  David  Kieras 
Prograe  in  Technical  Coeeunication 
College  of  Engineering 
1223  i.  Engineering  Building 
University  of  Hichigan 
Ann  Arbor,  HI  48109 

1  Or.  Janet  L.  Kolodner 
Georgia  Institute  of  Technology 
School  of  Inforeation  6 
Coeputer  Science 
Atlanta,  SA  30332 

1  Or.  Stephen  Kosslyn 
1236  Nilliae  Jaees  Hall 
33  Kirkland  St. 

Caebridge,  HA  02138 

1  Dr.  Pat  Langley 
University  of  California,  Irvine 
Departeent  of  Inforeation  and 
Coeputer  Science 
Irvine  ,  CA  92717 

1  Dr.  Jill  Larkin 
Departeent  of  Psychology 
Carnegie  Hellon  University 
Pittsburgh,  PA  15213 

1  Douglas  Lenat 
Coeputer  Science  Department 
Stanford  University 
Stanford,  CA  94Z06 

1  Or.  Alan  Lesgold 
Learning  RtD  Center 
University  of  Pittsburgh 
3939  O’Hara  Street 
Pittsburgh,  PA  ISOLD 

1  Dr.  Jie  Levin 
University  of  California 
at  San  Diego 

Laboratory  fof  Caspar ative 
Huean  Cognition  -  D003A 
La  Jolla,  CA  92093 
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Private  Sector 

1  Dr.  nichael  Levine 
Oeparteent  oF  Educational  Psychology 
210  Education  Bldg. 

University  oF  Illinois 
Chaepaign,  IL  61801 

1  Dr.  Harcia  C.  Linn 
LaMrence  Hall  oE  Science 
University  of  California 
Berkeley,  CA  f^720 

1  Dr.  Don  Lyon 
P.  0.  Box  44 
Higley  ,  AZ  8S236 

1  Dr.  Jay  McClelland 
Departeent  of  Psychology 

HIT 

Caibridge,  HA  02139 

1  Or.  Kathleen  HcKeoun 
Coluibia  University 
Oeparteent  of  Coeputer  Science 
Nea  York,  NY  10027 

1  Or.  Hark  Hiller 
Coeputer eThought  Corporation 
1721  Best  Plano  Parkway 
Plano,  TX  73073 

1  Dr.  Allen  Hunro 

Behavioral  Technology  Laboratories 
1843  Elena  Ave.,  Fourth  Floor 
Redondo  Beach,  CA  90277 

1  Dr.  Donald  A  Norean 
Cognitive  Science,  C-013 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

1  Dr.  Jesse  Orlansky 
Institute  for  Defense  Analyses 
1801  H.  Beauregard  St. 

Alexandria,  VA  22311 

1  Or.  Jates  M.  Pellegrino 
University  of  California, 

Santa  Barbara 
Dept,  of  Psychology 
Santa  Barabara  ,  CA  93106 


Private  Sector 

1  Dr.  Tjeerd  Ploep 
Teente  University  of  Technology 
Dept,  of  Education 
7300  AE  ENSCHEDE 
P.O.  Box  217 
THE  NETHERLANDS 

1  Dr.  Steven  E.  Poltrock 
KC 

9430  Research  Blvd. 

Echelon  Bldg  II 
Austin  ,  Tl  78739 

1  Or.  Hike  Pcsner 
Oeparteent  of  Psychology 
University  of  Oregon 
Eugene,  OR  97403 

1  Or.  Jaees  A.  Reggia 
University  of  Maryland 
School  of  Redicine  and  Hospital 
Oeparteent  of  Neurology 
22  South  Sreene  Street 
Baltieore,  HD  21201 

1  Or.  Fred  Reif 
Physics  Oeparteent 
University  of  California 
Berkeley,  CA  94720 

1  Dr.  Lauren  Resnick 
LRCC 

University  of  Pittsburgh 
3939  3’Hara  Street 
Pittsburgh,  PA  132’. 

1  Dr.  Jeff  Richardson 
Denver  Research  Institute 
University  of  Denver 
Denver,  CD  80208 

1  Hary  S.  Riley 
Prograe  in  Cognitive  Science 
Center  for  Huian  Intonation  P'-ocessing 
University  of  California,  San  Ciegc 
La  Jolla,  CA  92093 

1  Dr,  Ernst  Z.  Rathkopf 
Bell  Laboratories 
Hurray  Hill,  MJ  079^4 
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Privatf  Sfctor  Privati  Sector 

1  Dr.  Billiae  B.  Bouse  J  laees  J.  Steszeeski 

Georgia  Institute  of  TKhnology  Research  Associate 

School  of  Industrial  I  Syslets  Carnegie-Hellon  University 

Engineering  Departient  of  Psychology 

Atlanta,  BA  30332  Pittsliurgh,  PA  15213 


1  Or.  David  Ruaelhart 
Center  for  Huean  Inforeation  Processing 
Univ.  of  California,  San  Diego 
La  Jolla,  CA  92093 

1  PROF.  FUniKO  SMEJIHA 
DEPT.  OF  PSYCHOLOGY 
imiVERSITY  OF  TENNESSEE 
KNOIVILLE,  TN  37916 

1  Or.  Ntchael  J.  Saiet 
Perceptronics,  Inc 
6271  Variel  Avenue 
Moodland  Nslls,  CA  91364 

1  Dr.  Arthur  Saauel 
Yale  University 
Departient  of  Psychology 
Boi  HA,  Yale  Station 
Nei  Haven,  CT  06520 

1  Or.  Halter  Schneider 
Psychology  Departient 
603  E.  Daniel 
Chaipaign,  IL  61S20 

1  Dr.  Alan  Schoenfeld 
University  of  California,  Berkeley 
Departient  of  Education 
Berkeley  ,  CA 

1  Dr.  H.  Hallace  Sinaiko 
Prograi  Director 

Ranpoier  Research  and  Advisory  Services 
Siithsonian  Institution 
SOI  North  Pitt  Street 
Alexandria,  VA  22314 

I  Dr.  Eliott  Sol  Clay 
Yale  University 

Departient  of  Coiputer  Science 

P.O.  Bon  2158 

New  Haven,  CT  06520 


1  Dr.  Albert  Stevens 
Bolt  Beranek  I  Neiean,  Inc. 

10  Roulton  St. 

Caabridge,  HA  02238 

1  DR.  PATRICK  SUPPES 
INSTITUTE  FDR  HATHEHATICAL  STUDIES  IN 
THE  SOCIAL  SCIENCES 
STANFORD  UNIVERSITY 
STANFORD,  CA  94305 

1  Dr.  Nartin  fl.  Taylor 
DCIEH 
Bov  2000 

DoinsvieH,  Ontario 
CANADA 

1  Dr.  Perry  H.  Thorndyke 
FHC  Corporation 
Central  Engineering  Labs 
1165  Coleian  Avenue,  Box  !BO 
Santa  Clara,  CA  95052 

1  Or,  Douglas  Tome 
Univ.  of  So.  California 
Behavioral  Technology  Labs 
1845  S.  Elena  Ave. 

Redondc  Beach,  CA  90277 

I  Or.  Kurt  Van  Lehn 
lero*  PARC 

3333  Coyote  Hill  Road 
Palo  Alto,  CA  94304 

1  Dr.  Keith  T.  Hescourt 
FHC  Corporation 
Central  Engineering  Labs 
llSS. Coleian  Ave.,  Boi  520 
Santa  Clara,  CA  95052 

1  Dr.  Nike  Hilliais 
IntelliSenetics 
124  University  Avenue 
Palo  Alto,  CA  94301 


1  Dr.  Kathryn  T.  Speehr 
Psychology  Departient 
Broun  University 
Providence,  RI  02912 


END 
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